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ABSTRACT. We characterize the spectra of composition operators on the 
Hardy space H 2 {B^), when the symbols are elliptic or hyperbolic linear frac- 
tional self-maps of Bjy. Therefore, combining with the result obtained by Ba- 
yart [3J, the spectra of all linear fractional composition operators on H 2 (Bn) 
are completely determined. 



1 Introduction 

Let Bn denote the unit ball of C N , and let (p : —> B^ be an analytic map. In this 
paper, we consider the composition operator C v denned by C^(/) = f°f, acting on 
the classical Hardy space H 2 (B^). For N > 1, some authors gave the examples of 
unbounded composition operators on H 2 (B N ) (see Section 3.5 of [11J), which exhibit 
surprisingly different behaviors with the case of one complex variable. So many 
properties of composition operators in several variables are not easily managed. 
However, if the symbol if is a linear fractional self-map of Bm, that is, 

, , Az + B 



< z,C > +d 



for an N x N matrix A = [djk), two column vectors B = (bj), C = (cj) of N xl and 
d G C, such that ip maps the unit ball B^ into itself, applying Wogen's criterion |29j, 
Cowen and MacCluer [12] proved that is bounded on H 2 (B N ). In recent years, 
linear fractional maps of the ball and their composition operators on some analytic 
function spaces have been developed from various aspects, for example, geometric 
properties [5] and classification of semigroups [6] for linear fractional maps; cyclic 
behavior (see [2], jl], [20]) and essential normality (see [21], [27], [33]) of their 
composition operators. Similar to the case of the unit disk D, linear fractional 
self-maps of B^ give rich examples to exhibit the complexity of properties of the 
associated composition operators. Moreover, motivated by the fact that the linear 
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fractional model in D provides a useful tool to deal with composition operators 
induced by general maps, some authors began to study a linear fractional model for 
general maps of the unit ball, see [3] and [9]. 

In this paper, we are interested in the spectra of linear fractional composition 
operators on H 2 (Bn), this is a continuation of [4J. As a part of operator theory, the 
structures of spectra of composition operators are very important. Several authors 
have used this tool to investigate the cyclicity of composition operators (see [4], 
[14]). In the unit disk, the spectra of invertible and compact composition opera- 
tors on H 2 {D) have been described completely, while understanding the spectra of 
general composition operators is not easy. When ip is a linear fractional self-map 
of D, the spectrum of on H 2 (D) (see [8]) is well known. Recently, Higdon [15] 
completely gave the spectrum of C v on the Dirichlet space T>. Moreover, Hurst [16] 
obtained some results for the spectrum of C v on some weighted Hardy spaces. These 
results not only show the diversity of spectra of composition operators, and much of 
the spectral information depends on the behavior of ip near the Denjoy-Wollf point. 
From the table of [8], one has the following results. 

Theorem A. Suppose that ip is a linear fractional self-map of D, not automor- 
phism. The spectrum of C v on H 2 (D) can be described as follows: 

(i) If ip has an interior fixed point a, there exists two cases. When ip fixes a 
boundary point r, then 

( T(C,) = {A:|A|< V . / (r)- 1/2 }U{l}. 
Otherwise, C™ is compact for some positive integer n and 

a(C< p ) = {tp'(a) k :fc = 0,l,...}U{0}. 

(ii) If ip is parabolic, by the Cayley transformation, ip is conjugated to a map 
ifj(z) — z + t on the upper-half plane, then 

a(C v ) = {<& : /? < 0} U {0}. 

(Hi) If ip is hyperbolic with the Denjoy-Wollf point r G 3D, then 

a{C v ) = {A : |A| < vAr)- 1/2 }- 

In the unit ball, only the spectra of automorphism-induced composition operators 
and compact operators have been determined (see Chapter 7 in [H]). For other 
cases, less results have been obtained, even for the symbols being linear fractional 
self-maps of B^. Recently, Jury [22] has computed the spectral radii of linear 
fractional composition operators on H 2 (Bn), soon later, the spectra of composition 
operators were characterized by Bayart [1] when their symbols are parabolic linear 
fractional maps of B^. In order to illustrate these results, we recall some definitions 
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for the Denjoy-Wollf points and the classification of linear fractional maps of B^. 
In this paper, we denote by LFM(B N ) the set of linear fractional maps of B N . 
The Denjoy-Wollf Theorem of the unit ball is the following (see |25j). 

Theorem B. Let (p £ LFM(Bn) with no fixed points in B^. There exists a 
unique point r £ dB^ such that <p{r) = r and < d(p T (r),r >= a with < a < 1. 

The point r is called the Denjoy-Wollf point of (p and a is the boundary dila- 
tion coefficient. In particular, we call such a map hyperbolic when a £ (0, 1) and 
parabolic when a = 1. Otherwise, if ip has a fixed point in Bn, then we call it 
elliptic. 

Now, we have the following result for spectral radii of linear fractional composi- 
tion operators on H 2 (B N ) (see [22J). 

Theorem C. Let ip £ LFM{B^). The spectral radius of acting on H 2 (B^) is 
1 if ip is elliptic; if <p is non-elliptic with the boundary dilation coefficient a, then 
the spectral radius is a~ N ^ 2 . 

For a parabolic linear fractional self- map ip of Bn, considering its conjugating 
map ip on the Siegel half-plane Hn, Bayart |4J obtained a normal form of ip and 
gave a classification for this normal form. Based on this classification, he completely 
computed the spectrum of C v on H 2 (B N ). 

In this paper, we continue to investigate the spectra of linear fractional compo- 
sition operators on H 2 {B^) induced by the remaining maps, and we organize it as 
follows. In Section 2, we first look for a classification for elliptic linear fractional 
self- maps of B N , the idea comes from the classification of elliptic semigroups (see [5]) 
and the geometric classification according to their fixed point sets (see [5]). Differ- 
ent to the case of the disk, elliptic linear fractional maps of B^ contain three cases. 
Therefore, we will prove that the spectra of the associated composition operators 
have three different structures. For a general map <p, univalent, not automorphism, 
which fixes a point in D or B^, the spectrum of C v on many function spaces has 
been studied (see [10], [21], [2S], [31], [32J). It is easy to see that the proofs of these 
results follow the same pattern. We shall use an analogue approach to deal with the 
spectrum of C v on H 2 (B^), when the symbol ip is an elliptic linear fractional map 
with only one boundary fixed point. 

In Section 3, we devote to hyperbolic linear fractional self- maps ip of B^. It is 
well known that (p has only one or two fixed points on the boundary dB^ (see [5]). 
First, we will obtain a simple form for each conjugation map ip of ip on the Siegel- 
half plane H^- Applying these forms, we can completely determine the spectra of 
hyperbolic composition operators on H 2 (B^). In particular, when (p fixes only one 
boundary point, the spectrum of has a similar structure with the corresponding 
case in the disk, which has been proved in the first author's doctoral thesis [H]. For 
the case <p fixing two boundary points, Xu and Deng [30] recently used the method 
of Bayart [1] to obtain the spectrum of C v on H 2 (Bn). Thus, the spectra of all 
linear fractional composition operators on H 2 {B^) are completely characterized. 
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2 Spectra of elliptic composition operators 

In this section, we deal with elliptic linear fractional self-maps of and the spectra 
of the associated composition operators. First, we need a classification for these 
maps. 

Recall that a slice S is a non-empty subset of B N of the form S = B N nV, where 
V is a one- dimensional affine subspace of C . A dimensional slice of Sat is the 
non-empty intersection between B^ and a p-dimensional affine subspace of with 
p > 0. By Herve's theorem (see pLJ or |28j), if ip G LFM(B^) has a non-empty fixed 
points set in B^ then such a set is a p-dimensional slice of B^. 

In [5], Bisi and Bracci gave a geometric classification for linear fractional self- 
maps of Bn based on their fixed point sets. In this classification, elliptic linear 
fractional maps contain three cases. For elliptic semigroup of linear fractional self- 
maps of Bn, Bracci et al [6] also classified this semigroup into three different cases. 
Surprisedly, we find that there is a close connection between two classifications and 
obtain the following result. Let 

L v (<p, z ) = (J) ker(d(f zo - aI) N 
M=i 

for <f G Hol(-Bjv, Bn) with a fixed point zq G Bn, which is called the unitary space 
of ip at the point zq, the dimension of it is called the unitary index of ip (see [6]). 

Theorem 2.1. Let ip G LFM(Bn) be elliptic with a fixed point zo G Bn and 
let p = dim Lu(ip,Zo)- 

(1) If p> 0, then ip is conjugated to a map ip with 

ip{z', z") = {Uz\ Az"), (z', z") G C p x C N - p n B N , 

where U is a unitary diagonal matrix ofC pxp and A is a matrix of order N — p with 
\\A\\<1. 

(2) If p = 0, ip will fix at most one boundary point. In this case: 

(i) When ip has no boundary fixed point, then ip is conjugated to a map of the 

form 

ip(w) = Aw 

defined on a complex ellipsoid 

A 1 = { w = {w u v/) G C x C^ 1 : \\ Wl - Vr^Tl 2 + \w'\ 2 < r 2 } 

for some r > 1, where A is a matrix ofC NxN with \\A\\ < 1. 

(ii) When ip has only one boundary fixed point, then ip is conjugated to 

ip(w) = Aw 

on a half-plane 

A 2 = {w = (w u w') G C x C^ 1 : Re2 Wl > \w'\ 2 - 1}, 
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where A is a matrix of order N with \ \A\ \ < 1. 



Proof. We will use a similar argument as that of Theorem 3.2 and Corollary 
3.3 in [6] to obtain these results. Especially, the proof of (1) can be seen in [6] or 
Proposition 3.8 of [TH]. Here, we only give a proof for (2). 

If p = 0, it is clear that ip fixes only one interior point Zq. Up to conjugation with 
automorphisms of B^, we may assume that z = 0. We claim that (p fixes at most 
one boundary point. Otherwise, if <p fixes two points on dB^, by Theorem 3.2 of 
[5], (p is conjugated to a map which has a hyperbolic automorphism (not identity) at 
first coordinate. Thus, <p has no fixed point in Bn, which contradicts with (p(0) = 0. 
When ip has more than two boundary fixed points, similar to the argument in the 
proof of Theorem 3.1 in [5], (p will fix a g-dimensional slice of B^ with q > 1. This 
means that the unitary index p of ip must be larger than q, contradicting to the 
hypothesis p = 0. So that the claim is true. 

Now, tp(0) = gives 

= <z,C>+l 

for some A G <C NxN and C G C^. Since <p maps 5^ into B^, we have |C| < 1. A 
computation shows that d<po = A. Thus p = implies ||A|| < 1, that is, A* — I 
is invertible. Immediately, there exists a vector V G such that (A* — I)V = C 
and 5 := |V| < 1. Conjugating <p by a unitary map £/ with C/*V = <5ei, where 
ei = (1, 0, . . . , 0) G dB N , we obtain 

ip(z) 



5 < z, (A* - I)e x > +1 
with At = U*AU and ||Ai|| < 1. Define 

<t(z) = / ■ - , * = G C x C^ 1 n BjV; 

— 0Zi + 1 

it is an one-to-one holomorphic linear fractional map from Bn onto := a(B^) 
Consequently, we deduce that 

cr o cp(z) — Ai<r(z), z G B N , 

and 

n = {w = (w u w') G C x C^ 1 : ll + Swt] 2 > \w'\ 2 }. 
If ip fixes no boundary point, then 5 < 1. Otherwise, 5 = 1 implies that 



cp(z) 



< z, (A\ - i>i > +1 



has a boundary fixed point e\. So ip also fixes a boundary point, which is a contra- 
diction. If we set r = (1 — 5 2 ) _1//2 , then r > 1 and 

n = Ax = {(twi, iuO G C x C^ 1 : - v^^Tl 2 + K| 2 < r 2 }. 
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If tp fixes only one boundary point, then tp also has only one fixed point r G OB n- 
It follows that 

Ai<j(t) = a o <p(r) = cr(r), 

that is, <t(t) is a fixed point of the matrix A\. since ||Al|| < 1, we see that er(r) = 
or cr(r) = oo. However, cr is an one-to-one map from Bm onto ft and cr(0) = 0. 
This implies cr(r) = oo. Thus, we have — 8t\ + 1 = and 8 = ^ > 1, where Ti 
denotes the first coordinate of r. Which combining with S < 1 yields 5 = 1. Hence, 
a calculation shows that 

ft = A 2 = {(iui,u/) G C x C^ 1 : Re 2^ > |w/| 2 - 1}, 

which is a domain similar to the Siegel half-plane. □ 

Next, we will apply this classification to compute the spectrum of C v on H 2 (Bn), 
when the symbol (p is a elliptic linear fractional self- map of B^. In the first case 
of Theorem 2.1, (p is conjugated to a map ip(z',z") = (Uz',Az"). Let = 
{Ai, . . . , Aat} be the union of the spectrum of U and A, and write A° for A" 1 • ■ ■ A^, 
where a is a multi-index of N N . In this case, we have the following result for the 
spectrum of C 9 , the proof is inspired by that of [I] in computing the spectra of 
parabolic composition operators on H 2 (Bjy). 

Theorem 2.2. Let (p G LFM(Bn) be elliptic, non- automorphism, and let p = 
dim Ljj(ip,Zo) for its fixed point zq G Bn- When p > 0, the spectrum of C v on 
H 2 (B N ) is 

(i) a union of circles if U has an irrational unimodular eigenvalue: 

a{C v )= |J A;TU{0}; 

aen N 

(ii) cr(C^) = U A° U {0} if all eigenvalues of U are rational. 

Proof. By Theorem 2.1, we see that ip is conjugated to a map with the form 

i/>(z, w) = {Uz, Aw), {z, w)eC p x C N - p n B N , 

where U = diag(e l6>1 , . . . ,e l9p ) and \\A\\ < 1. Up to conjugation by a unitary map, 
we may assume that A is upper-triangular with the diagonal entries Ai, . . . , Xn- p , 
which obviously are the eigenvalues of A. Next, we will determine the spectrum of 

For each i G {1, . . . , N — p}, let w(i) = (u^i, . . . , Wi,jv_ p ) T be a non- zero eigen- 
vector of A T associated to Aj, i.e. A T w(i) = \iw(i). Write w = (wi, . . . ,wn- p ), we 
consider the function 

F(z, w) = z p [w w(l)] 71 ■■•[ww(N- p)] 7iV - p , (z, w)eC p x C N - p n B N , 

where (3 = (0 1} . . . /3 P ) G W and 7 = (7^ . . . , 7 W _ p ) G N N ~ P . It is clear that [w w(i)]^ 
is a homogeneous polynomial of w with degree 7$. So that F belongs to H 2 (B^) 
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and 



F o ip(z, w) = {Uzf[wA T w{l)) 11 ■ ■ ■ [wA T w(N - p)]w-» 

= e mh+-Mp)xn . . . Xg^Av ^C 1 )] 71 • ■ • [ww(N - p )]w-p 
= e ^+-p v e P ) X n . ..x]?s;F(z,w). 

Thus, for any multi-index a = 7) G N N , ^(ft^-AA) \f . . . A^_" P P is an eigenvalue 
of with the eigenvector F. Hence, cr(C^) contains the set [J U {0}. If U 

has an irrational eigenvalue e l9j , then the set {e lfc0J 'A 71 ■ ■ ■ Xj^Sp '■ k G N} is dense in 
the circle |Ai| 71 • • • \\n-p\ 1n ~ p ■ Note that this set is contained in cr(C^) and cr(C^) 
is closed, it follows that cr(C^) contains |J A°T U {0}. 

For another direction, as in the proof of Lemma 5.4 in pE], we need the following 
notations. For 7 G N N ~ P , let if 7 be the set of all functions F in H 2 (B^), which 
have the form F 1 (z)w' y . It is clear that F 1 {z)w 1 and F / 3(z)w' 3 are orthogonal if 
7 7^ (3 G N^ - *'. So we have the orthogonal decomposition H 2 {Bn) = © 7gN jv_p if 7 . 
If we set K n = 0^|> n # 7 for any n > 0, then # 2 (Btf) = 0, 7 | <n # 7 © K n . Write 
F = F y (z)w' r , we see that 

N-p , . Tj . 

F oijj(z,w) = F 7 (U z) Y[ f \wj + ^ aj, fcWfc J . 

j=i \ fc>j ' 

After introducing a natural order on the set N Ar_p (see [11, p. 26] or [1]), if we use this 
ordering for the decomposition H 2 (Bn) = ©| 7 | <n H^Q)K n , then the matrix of C$ is 
upper-triangular. Set p(z,w) = (Uz,w), let T 7 and S 7 respectively denote the diag- 
onal blocks of C$ and C p corresponding to iJ 7 , then we have T 7 = A 71 ■ ■ ■ \£~*S T 
Since p is an elliptic automorphism of B^, by Theorem 7.6 of [llj, the spectrum 
of C p on H 2 (Bn) is the closure of all possible products of the eigenvalues of U, 
which denoted by X. If U has an irrational eigenvalue of modulus 1, then X = T. 
Applying Lemma 7.17 of [TT] or Lemma 5.3 of |4J, we get cr(S' 7 ) C X and 

a(CV) C |J a(T 7 ) U a(C m J 
It1<" 

\l\<n 

Since the spectrum of C^\k„ must be contained in the disk of radius ||C^,|jf n ||, we 
will obtain the desired result if we can show that ||C^ijf n || tends to zero as n tends 
to infinity. 

Let A = TY,V be a singular value decomposition of A, where T, V are unitary and 
S is diagonal with the diagonal entries pi, . . . , Pn- p - We see that pi, . . . , Pn- p are 
the non-negative square roots of the eigenvalues of AA* and p = max{/zi, . . . , Pn~ p } < 
1. Set <pi(z,w) = (Uz,Vw), i/j-z(z,w) = (z,Tiw) and (f>2(z,w) = (z,Tw), so that 
Cv = CfcC'fcCfa. Note that and 2 ar e automorphisms of B N , it follows that 
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Cfa and C<p 2 are invertible on H 2 (B N ). on the other hand, K n and K„ are stabled 
by Cfa and C^ 2 . Therefore, we only need to calculate that ||C^ E |xJ| goes to zero as 
n — > oo. 

Let F = F 7 (2;)w 7 G K n . Composing it by ips, we get 
ItI>™ 

|7|>n |7|>«- 

If we denote C = (C, C") ePx C^"? n dB N , then 
||C fe F|| 2 = sup / |Fo^(rC)| 2 ^(C) 

0<r<l JdB N 

= sup [ \r hl »?---»l N -ZFM')(Cr\ 2 d*(0 

< V^l sup / iF^rOKTI^O^^II^II 2 - 

| 7 |>n 0<r<lJ d B N 

Here and other places in this paper, we let 1 1 • 1 1 denote the norm of H 2 (Bn). Applying 
/i < 1 to the above inequality and let n go to infinity, we get the desired conclusion. 
□ 

In the second case, we find that C™ is a compact operator for some positive 
integer n, so that the spectrum of C v is easily known. 

Theorem 2.3. Let <p G LFM(B N ) be elliptic, non- automorphism, and let p = 
dim Lu({p, zq) for its fixed point z G -Bat. If p = and ip fixes no boundary point. 
Then the spectrum of on H 2 (B N ) is the set consisting of 0, 1 and all possible 
products of the eigenvalues of<p'(z ). 

Proof. Applying Theorem 2.1, p is conjugated to a linear fractional map ip of 
Bn with 

a o ip = Aa, 

where a is an one-to-one holomorphic map from B^ onto a complex ellipsoid Ai 
and A is a matrix of <C NxN with ||A|| < 1. Moreover, in the proof of Theorem 2.1, 

we have V'(O) = an d °"(0) = 0- 

Let ip n denote the n-th iterate of ip, then ip n = a~ 1 A n cr and ^"(0) = 0. We 
claim that there exists a positive integer n so that C^n is compact. Since the set 
Ai = a(B N ) is compact in and \\A\\ < 1, we see that sup{|A n cr(z)| : z G B N } 
goes to zero as n tends to infinity. Thus, there exist a positive integer M and a 
positive constant r < 1 such that 

sup \a~ 1 A n a(z)\ < r 
zeB^ 

holds for all n > M. That is ||^ n ||oo < r < 1 for such n. As we know, a linear 
fractional map <p of B^ is compact on H 2 (Bn) if and only if ||0||oo < 1- It follows 
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that C^n is compact. Thus, by Theorem 7.2 of [TTJ, the spectrum of C^n is the set 
consisting of 0, 1 and all possible products of the eigenvalues of (ip n )'{Q) = ^'(0) n . 
On the other hand, the spectral mapping theorem gives [cr(C</,)] n = cr(C^) = a(C^n). 
Hence, the spectrum of has the desired structure. □ 

For the last case in Theorem 2.1, the structure of the spectrum of on H 2 (Bn) 
is similar to that in one variable with the symbol fixing a boundary point (see 
Theorem A). So we first need to compute the essential spectral radius of C v . For 
C G dB N , we will use the notation 

^( C ) = liminf I^M£!I 

z->C 1 — \z\ 
for an analytic map <p of Bn into itself. 



Lemma 2.4. Let ip G LFM(Bn) be elliptic, non- automorphism, and let p = 
dim Lu(<f,z ) for its fixed point z G B N . If p = and ip fixes only one boundary 
point. Then the essential norm of on H 2 (Bn) satisfies the following inequalities: 



N . N_ 

2 



limsup , < \\C v \\ e < C limsup I 

/or a positive constant C. So the essential spectral radius of C v is 

N/2\ i 

feiC^) = lim I limsup 



|*|-H \l-\<p n (z. 



12 



Proof. Conjugation by a unitary map, we may assume that ip fixes and the 
boundary point e±. We first claim that |y?(C)| < 1 f° r an y boundary point ( ^ e%. 
Otherwise, if there exist two boundary points C 7^ e i an d V such that y?(C) = ?7, we 
will get a contradiction. 

Let L(ei, () = {ce\ + (1 — c)( : c G C} D B^ denote the one-dimensional affine 
subset of Bn determined by ex and ( and let [ei] denote the slice in B^ through and 
e\. If T] ei, then </? maps the slice L(ej, C) onto L(ej, 77) with a boundary fixed point 
ei. When £ is on the slice [ei], since ip(0) = 0, we see that L(ei, () = L(ei,T]) = [ex]. 
Thus, <p restricting to [ei] must be identity, which contradicts to p = 0. Otherwise, 
assume that Tx and r 2 are automorphisms of B^ fixing ex, and they map [ei] onto 
L(ex,C) an d L(ei,rj) onto [ei] respectively, such that the restriction of T2 o <p o n 
to the slice [ei] is a linear fractional self-map of this disk onto itself with only one 
boundary fixed point ex- Moreover, its boundary boundary dilation coefficient at 
ex satisfies a > c^(ei). Note that ip is an elliptic linear fractional map of B^ with 
<f(0) = 0, which gives d v {e\) > 1. Thus, we have a > 1. It is impossible for an 
automorphism of the disk with only one boundary fixed point. 

If 77 = ex, we see that <p(ex) = ip(() = ex and ip maps L(ex, C) into a slice S in B^ 
through ex- Then the restriction of r 2 o ip o tx to [ei] is a linear fractional self- map 
of this disk, where T\ and r 2 are automorphisms of B N mapping [ei] onto L(ex,() 
and S onto [ei] with ri(ei) = T 2 (ei) = ex- Suppose Tx(a) = (, then r 2 o^or 1 |[ ei ] is a 
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linear factional map of the disk mapping two boundary points e\ and a to e\. So it 
is a constant with modulus 1. Therefore, \t% o ip o Tx(z)\ = 1 for any point z e [ei], 
that is, = 1 for any z 6 L(e\,(), which contradicts to the fact p{B^) C -Bat. 

Thus, we show the claim. 

Next, we will estimate the essential norm of C v . Since ||C^|| e = ||C*|| e = 
inf{| |C* — F| | : F is compact}, it is easy to see that 



\C v \\ e > limsup 

\z\^l 



c: K 



f I 



K, 



lim sup ( ' 



lim sup 

N/2 



\ K ^{z)\ 

\\KJ\ 



where ||T|| e denotes the essential norm of a operator T and K z {w) = ( - 1 _ <z 1 w> ^ JV is 
the reproducing kernel of H 2 (Bn). 

We introduce the pullback measure t v on E>n defined by t v (E) = o"[((/9*) _1 (£')] 
for Borel subsets E of Bn, where <p* denotes the radial limit of <p. Then 



fo<p*(C)MC)= _fdr v 

dB N J B N 

for every Borel function / > on B^. Let I T denote the densely defined inclusion 
operator of H 2 (Bn) into L 2 (t v ). Using Theorem 5.1 of [7], we get 

I \n 1 12 _ 1 1 j 1 12 ~ 1 1 1 1 
where the "essential Carleson norm" is defined by 



11^116,0 = limsup sup . . 

t-»0 C&dB N &{Q{t,,t)) 

with n(C, t) = {z e B~^ : | 1- < z, ( > \ < t} and Q(C, t) = t) n dB N . 

Since (p(ei) = t\ and <p maps any boundary point C 7^ e i into B^, this gives 

llrll t -hmsup ^^l - limsup ^j^M^ 

W'tp \\e,C — 11111 bu P /^/ ,\\ — imibup 

Applying similar arguments as for proving <p(Q(£, t)) C fi(r/, At) with = r/ in 
Lemma 3.40 of [11], where A is a constant depending on d v ((), we can calculate 
that 

i Wkc=limsup ^M^%i)i =limsup f i-w \ K 



because of cr(Q(ei,i)) ~ t . Therefore, 

sup( j — - 

1*1 



/ l-|d 2 V 
|C v |le < C|l r v lle,c < C limsup 
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holds for a positive constant C. Note that the essential spectral radius of C v can be 
computed by r e (C v ) = lim ||C£||e / ' n = lim 1 1 [ | e^ n and we have obtained that 

12 \ N/2 



09 I . 

n— >oo r n— >oo 



|CV|| e — lim sup 

\z\^l 



\Z\ 



Thus, we get 



r e{Cw) = lim HC^Iiy™ = lim ( lim sup ( 



1 - \z 



2 \ N/2 



1 - \<p n (z)\ 2 



□ 

Kamowitz [T7] was the first to investigate the spectrum of C v on H 2 (D) when p 
has an interior fixed point a, he proved that ciC^) = {A : |A| < r e (C^,)} U {p\a) n : 
n = 1, 2, . . .} U {1} if <p is analytic in a neighborhood of D, not an inner function. 
In [10] Cowen and MacCluer obtained the same spectral structure for C v when ip 
is univalent, not automorphism, and <p(a) = a G i?Ar. From their results one can 
easily deduce the spectrum of C v if ip is a linear fractional map of D with an interior 
and a boundary fixed points (see Theorem A). Moreover, the method of Cowen and 
MacCluer was used by many authors to study the spectrum of C v on other spaces 
for <p in the same case, For example, on H°°(D), the Bloch space and BMOA in one 
variable, see [32], [26], [23]; for a generalization on H°°(Be) and H°°(Bn) see [TJ] 
and [31], where Be is an open unit ball on a complex Banach space. We will use 
same ideas and approaches suggested by the work of Kamowitz and that of Cowen 
and MacCluer to obtain the following result. 

Theorem 2.5. Let ip be the same as in Lemma 2.4- Then the spectrum of 
on H 2 (B N ) is 

cr(C ¥ ,) = {A : |A| < p} U {all possible products of the eigenvalues of <p'(zo)} U {1}, 
where p is the essential spectral radius of C^. 

As in the proof of Lemma 2.4, we may assume <p(0) = and p{e{) = e\. For non- 
negative integers m, let % m be the subspace of H 2 (B N ) spanned by the monomials of 
total degree greater than or equal to m, that is, any function / 6 % m can be written 
as / = ^2\ s \ >m f s , where f s is a homogeneous polynomial of degree s. Obviously, 
1-lra is invariant for C v . A easy computation shows that the reproducing kernel in 
Hm at the point w is 



(N-l + s 

\s\>m 

In particular, we have 



\s\>m K '' 



s 



rai"=E (w 



(N — l)!s! 

\s\>m K ' 



\w 



2s 
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and 

C" \m\ m \\K II < ll/^™ 1 !! < C" \m\ m \\K II 

where C' Nm and C'^ m are positive constants only depending on N and m. 

Just as in the disk, our generalization for Proposition 7.32 of [11 J to the unit 
ball is the following lemma. We only need a similar argument used in computing 
the spectrum of a compact composition operator on H 2 (B N ), so the proof will be 
omitted. 

Lemma 2.6. For <p as in Lemma 2.4, the spectrum of C v on H 2 (Bn) contains 
1 and all possible products of the eigenvalues of (p'(zo). Moreover, if A ^ is an 
eigenvalue of C^, then A will be a product of the eigenvalues of(p'(z ). 

We say the sequence of points {z k }^ K is an iteration sequence for cp if ip(z k ) = 
Zk+i for k > —K. In the proof of Theorem 2.5, the following fact will be needed. 

Lemma D. [10J If ip maps the unit ball into itself, ip(0) = and ip is not unitary 
on any slice in B^. Suppose r < 1 is given and {zk}^ K is any iteration sequence 
with \z n \ < r. Then there exists c < 1 such that < c f or all k > n. 

Lemma E. |10j For tp in Lemma D and < r < 1. There exists M < oo such 
that if {zk}™K ^ s an iteration sequence with \z{\ > r for some I > and if {w k }°^ K 
is arbitrary, then there is h in H°°(Bn) such that h(zk) = w k for —K < k < I and 
\\hWoo < Msup{K| : -K < k < I}. 

Proof of Theorem 2.5. Using Lemma 2.6 and the fact that the spectrum is 
closed, it suffices to prove 

{A : |A| < p} C a{C v ). 

Let C m = C lf ^ m and assume < |A| < p. By Lemma 7.17 of [H], if we can show 
that A is in the spectrum of C m for some positive integer m, then we get the desired 
conclusion. So we will try to find a positive integer m such that C m — XI is not 
bounded from below. 

Fixing 5 with < 5 < 1, suppose we have an iteration sequence {z k }°? K with 
| | > S. Let n = max{k : \z k \ > 6}. By Lemma D, we can choose c with y/5 < c < 1 
such that \z k+ i\ < c\z k \ for \z k \ < y/~8. On the other hand, if \z n \ > \/5 > 5, then 
l^n+il < 5 < y/S\z n \ < c\z n \. Thus, we have \zk+i\ < c\z k \ for all k > n. By 
induction, \zk\ < c k ~ n \z n \ holds for all k > n. 

oo 

Now, let's define L x = £ \- (k+ ^K™, we will see that L\ is well defined and it 

k=0 

is bounded. For k > n, \z k \ < 5 gives that 

I 2 \ m 

1 1 T<" m 1 1 <^ I -v I m 1 1 l<" II f^ 11 I I ^ fi\ „ I m 

1 1 1 1 ^N,m\ z k\ W^ZkW — °JV,m/-| _ i |\jv/2 — ° 1**1 ' 
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where C is a positive constant depending on N, m and 5. It follows that 

k—n 



E \M- {k+1) \\KT k \\<c E 



k=n+l k=n+l 11 11 k=n+l 

Since c < 1, if we choose m so large that c m < |A|, then the series defining L\ 
converges. 

Next, we will estimate ||(C^ — AJ)Lx||/||La||. Since "H m is invariant for C v , it is 

easy to see C*K™ = K™ {w) and so 



m \ —A; i^m 



OO OO y 

(Cm " A/)L A = - A/) £ A-( fc+1 ^ = £ ( A-( fc+1 ^« 

fc=0 fc=0 ^ 

k=0 ^ ' 

This means ||(C m — A/)La|| = ||-f ~||- It remains to give a lower bound for ||La||- 

Choose an m- homogenous polynomial P(z) on Bn satisfying ||P||oo — 1 an d 
\P{z n )\ = \z n \ m - It is clear that \P(z)/\z\ m \ = |P(^/|^|)| < 1 for any z E B N , which 
gives \P(z)\ < \z\ m . Applying Lemma E to the iteration sequence {z k }^ K , there 
is a function g £ H°°(B N ) such that ||g||oo < M, g(z k ) = for < k < n, and 
g(z n ) = 1. For / = (1 _ < ^ >)JV , we obtain 

/ OO \ OO 

<L X j->=(y2^ {k+1) K::j) = \- (n+i) iW)+ E ^ (fc+1) 7M- 



k=n+l 



Note that |zfc| < 5 for /c > n, so |1— < Zk,z n > \ N > (1 — l-Zfcl)^ > C(5). Choose m 
large enough so that c m /|A| < 2N +2 M , we calculate that 



E^ ,i+,, 75)= E wi P(z ' )9(2l) 

fe=n+l 

oo 

s E 



fc=n+l 



A fc + 1 (l-<^,^n>) iV 



oo 



< 



fc=n+l 



|A| fe+1 |l- < z fc ,z n > 



A? 



k=n+l 



|A|*+i|l- < > r " C(*)|A|"+i fc f^A|A| 



Ef 



c 



< 



2^+ 1 C(5)|A|«+ 1 ' 



Therefore, 

I < W> I > 



A- (n+1) /(^ 



fc=n+l 



> 



2|A|«+ 1 (1- 




2)iV 


1 ~ Im 
1 "1 


1 




2|A|« +1 (1 - 






1 ~ Im 
\ n\ 


1 




2|A|« +1 (1 - 




2*jN 



+ 



1 l^n)<?( 




1 




m 


2 - 

1 ~ \m 


Zn 

1 


2)^v 2 N + 1 C(5)\\\ n + l 

1 ~ Im 
1 "I 


2|A|" +1 (1 - 


Zn 


2 )iv 2^ V + 1 C(<5)|A|»+ 1 
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where we have used the fact that \z n \ > 5 gives (1 — l^nl 2 )^ < 2 N C(5) to obtain the 
third inequality. Since 



Pg 



(1- < z,z n >) 



N 



M 

< 



(i-kl 2 )^ 2 ' 



we deduce that 



I , T f . I i 

|£,J| > I < La '^ > I > 2|A|«+i (l-knl 2 )^ 



M 







m 


1 






m 1 


K Zn \\ 


2M|A|™ +1 (1 - 




2^N/2 


2M\, 


\ n+l 



> 





l^m 1 




2MC' |, 


\ n+l 



Hence, 



||(^-A/)L A || < 2MC^ m |Ar+ 1 ||X ; 



l a ~ \\K?\ 



When m is fixed, we see that | j -K"^ 1 1 j < \ \K W \ \ < \\K™\ \ + C rn for all w G -Bat, which 
gives 

1 1 K m II 1 1 i/~ II 
\\ J - y ip n (w)W I \ Jx f n {w) 1 1 



iii^ m ii iik ii 

I r v «j 1 1 I \ iy w\ | 

On the other hand, by Lemma 2.4, the essential spectral radius of is 

\K<p n (w) | | 



1 - 




w 


2 


1 - 


ip n (w)\ 2 



p = lim I lim sup I ; — — = lim lim sup 

The above arguments show that 



«->-°°\ \ w \^i \\K W \ 



i 



p = lim ( lim sup 



I K m 

Since p > 0, we have lim sup | J| = oo for every n. Thus, for any positive 

integer n, there exist points w near such that |</? n (w)| > 5. Moreover, there 
exists p' with |A| < p' < p such that 

1 1 K m 

11 ^"W 11 ^ / J\n 



\Kl 



> (p'r 



Let Zq = w and zj, + i = ip(zk) for k > 0. It is clear that the iteration sequence {-2fc}Jf 
satisfies \z \ > \z n \ > 5. Consequently, for this iteration sequence, we obtain 



1 1 (C* m - XI) L x 1 1 1 1 (C* m - XI) Er=o \~ {k+1) K, 



in 

Zk I 



■VOO 

A "'"•'/\. 

z k 

2MC' Mm \X\ n+1 \\K m 



YI=^- {k+1) K? k \ 



p' 
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Note that |A| < p', we may form iteration sequences for which n is sufficiently large, 
so that the above inequality is sufficiently small. This forces that — XI is not 
bounded below. Hence, — XI is not invertible and so we complete the proof. □ 



3 Spectra of hyperbolic composition operators 

Let tp be a hyperbolic linear fractional self- map of Bn, it may have one or two 
boundary fixed points. This implies that the associated composition operator 
may have different characterization for its spectrum on H 2 (Bn)- First, we will find 
a conjugated form of tp on the Siegel half-plane for each case. 

Recall that the unit ball B^ is biholomorphic to the Siegel half-plane = 
{(z,w) G C x C^ -1 : Rez > \w\ 2 } via the Cayley transform o c defined by 

a c (z,w)=( 1 -±^,-^-), (z,w) eCxC N -\ 



1-z' l-z j 

It extends to a homeomorphism of Bn onto Hn U OHn U {oo}, the one-point com- 
pactification of H^. Its reciprocal is given by 

z-1 2w 



a c [z,w) 



z + 1 z + 1 



Let tp be a linear fractional map of B^ with Denjoy-Wollf point e\ and boundary 
dilatation coefficient a. Applying Proposition 4.2 of [B], (p is conjugated to a map 
ip on Hn with the form 

ip(z, w) = —(z+ < w,b > +c, Aw + d), (z, w) G H N , 
a 

where c G C, b, d G C^ 1 and A G C^ 1 )*^ 1 ), which satisfy aRec > \d\ 2 and 
||^4|| < yfoL- If V 9 is hyperbolic, then a < 1. Combining this with \\A*\\ = \\A\\ < 
\fa < 1, we see that A* — I is invertible. Thus, there exists a vector k\ G C^ -1 such 
that b = 2(A* — I)k±. Consider the following Heisenberg transformation 

7](z, w) = (z + 2 < w, ki > +k 2 , w + ki), (z, w) G H N , 

with Re/c2 = \ki\ 2 , it is an automorphism of H^. Conjugating ip by rj, we obtain 

4>(z, w) = r/^ 1 O ij) o r](z, w) = — (z + c', Aw + d'), (z, w) G H N , 

a 

where d G C, d' G C* -1 and aRec' > |ci'| 2 . If d = d + ic 2 with c u c 2 G R, let 
v{z, w) — (z — jz^,w), then v is an automorphism of and 

v^ 1 o (f) o //(z, w) = — (z + Ci, Aw + d'), (z, w) G H N , 
a 

with aci > \d'\ 2 . Thus, we may assume c' G M. 
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Therefore, similar to the classification of semi-group of hyperbolic linear frac- 
tional self-maps of in [6], we have the following result. 



Proposition 3.1. Let <p is a hyperbolic linear fractional self-map of with the 
boundary dilatation coefficient a. 

(i) If (p fixes only one boundary point, then ip is conjugated to a map 4> of the 
form 

(f)(z, w) = —(z + c, Aw + d), (z, w) G H N , 
a 

where c G R, d G C^" 1 with ac > \d\ 2 and A G c(n-i)x(n-i) satls f ymg \ \A\ \ < y/a. 

(ii) If ip fixes two boundary points, then ip is conjugated to a map (ft of the form 

(p(z,w) = (-, — 1), (z,w)eH N , 
a y/a 

where A is a matrix of order N — 1 with \ \A\ \ < 1. 



Proof. The previous arguments give that <p is conjugated to a map on the Siegel 
half-plane with the form 

(p(z, w) = —(z + c, Aw + d), 
a 

where c G R with ac > \d\ 2 and ||A|| < y/a. If ip fixes only one boundary point, 
then c 7^ 0. To see this, we may assume c = 0. It is clear that d = from |<i| 2 < ac. 
A calculation shows that the conjugate map (f) of ip fixes two boundary points and 
oo. So ip> must have two boundary fixed points and we get a contradiction. 

If ip has two boundary fixed points, so is its conjugate map 0. Let (z, w) G dH N 
be another fixed point of cf) different from its Denjoy-Wollf point. We see that 
Rez = \w\ 2 , z + c = az and Aw + d = aw. Since c G R and a < 1, then c = (a — l)z 
gives c < 0. On the other hand, we have ac > \d\ 2 > 0. Thus, c—d — and so the 
conjugate map 4> of (p has the form 

<p\z, w ) = -\ z , Aw ) = (-> —f=) 

a a y/a 

with \\A'\\ = ll-Mll < 1. □ 

Now, we will compute the spectra of hyperbolic composition operators on H 2 (Bn). 
For the case ip fixing only one boundary point, we need the technique used in deter- 
mining the spectra of composition operators on some weighted Hardy spaces, whose 
symbols are hyperbolic automorphisms of B^ (see Theorem 7.7 of [H]). Moreover, 
the spectrum of C v has similar properties as that in the disk. This result has been 
obtained on some weighted Hardy spaces in the first author's doctoral thesis [T9] . 

Theorem 3.2. Let ip G LFM(B^) be hyperbolic, non- automorphism. If ip has only 
one boundary fixed point with the boundary dilatation coefficient a. Then the spec- 
trum and the essential spectrum of on H 2 (B^) are the closed disk |A| < aT N l 2 . 
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Moreover, every point in the disk \X\ < a N ^ 2 is an eigenvalue of C v of infinite 
multiplicity. 

Proof. Proposition 3.1 tells us that <p is conjugated to a map 

4>(z, w) = —(z + c, Aw + d), (z, w) G H N , 
a 

with ac > \d\ 2 and < y/a. Transferring back to the unit ball by the Cayley 
transform ac, we have 



ip(z, w) = o c x O o o~c(z, w) 

1 + c- \ + {l-c + \)z 2Aw + 2(1 -z)d 



1 + c + A + (1 - c - X)z' 1 + c + A + (1 - c - X)z 



z, w) G B N . 



Next, we will determine the spectrum of C^. We first prove that each point in 
the disk |A| < oT N l 2 is an eigenvalue of of infinite multiplicity. For z G D, define 

~, N 1 + c- A + (1 -c + X)z 
MZ) = l + c + X + (l-c-X)z 

and set 

m ~ (N-l + k)V 

If we set P(k) 2 = {N -l)\{k+l) 1 - N , then (3{k) 2 > (3{k) 2 and H 2 {(3,D) C H 2 0,D), 
where H 2 (f3,D) and H 2 (fi,D) respectively denote the weighted Hardy spaces with 
the weights and f3, see Section 4 for their definitions. 

Since c > 0, the linear fractional self-map ip\ of D fixes one boundary point 1 and 
the other point zq = fzjr^ with \zo\ > 1. In Theorem 8 of [16], Hurst has investigated 
the spectrum of C-^ on the weighted Hardy space H 2 ((3, D) with the weight f3(k) = 

(k + l) a (a < 0), and proved that each point of the disk |A| < (ipi)' '(l)( 2a_1 )/ 2 is an 
eigenvalue of of infinite multiplicity. It is clear that 1 — iV < 0. Therefore, using 

Hurst's result, if A is in the disk |A| < (ipi)'(l)^ N ^ 2 , we may find infinitely many 
linearly independent functions / in H 2 (f3, D) C H 2 (f3, D) such that f o%p l = Xf. For 
(z,w) G -Bat, define the extension operator by Ef(z,w) = f(z), by Proposition 2.21 
of [UJ, E is an isometry of H 2 ((3, D) into H 2 (B N ). Note that ipi(z) = ipi{z, w) and 
(^i)'(l) = a, where ipi is the first coordinate of ip- Thus, we have Ef G H 2 (B N ) 
and 

Ef o ?/>0, w) = Ef{$i{z, w),..., ip N (z } w)) = fo ifa(z, w) 
= fo^(z) = Xf(z) = XEf(z,w). 

This shows that A is an eigenvalue of on H 2 (B^) of infinite multiplicity. 

By Theorem C, we see that the spectral radius of is a~ N ^ 2 . Hence, the 
spectrum of is contained in the disk |A| < oT N l 2 . Since the essential spectrum 
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is contained in the spectrum and contains all eigenvalues of infinite multiplicity, we 
obtain the desired conclusion. □ 

Finally, when a hyperbolic linear fractional map ip fixes two boundary points, 
the first author [19] has proved that each point of the annulus a N ^ 2 < |A| < a~ N ^ 2 is 
an eigenvalue of on H 2 (Bn) of infinite multiplicity, and its spectrum is contained 
in the disk |A| < oT N l 2 . Applying a different approach, Jury [23J obtained the same 
result. Recently, the spectrum of C v has been determined by Xu and Deng [30J, the 
main idea also comes from Bayart [3]. By Theorem 3.1, we see that <p is conjugated to 
a map on Hm with the form cj)(z, w) = (^, ^=), then the spectrum of C v is as follows. 

Theorem F. Let p G LFM(Bn) be hyperbolic, non-automorphism. If ip fixes two 
boundary points with the boundary dilation coefficient a, then the spectrum of C v 
on H 2 (B N ) is 

a{C^)= |J A^U{0}, 

where A 13 denotes Af 1 ■ ■ • X^-i with Ai, . . . , Aat_i the eigenvalues of A and S is the 
annulus {A : a N ' 2 < |A| < a~ N / 2 }. 

4 Concluding remarks 

Now, the spectra of all linear fractional composition operators on H 2 (Bn) have 
been completely determined. Moreover, some works are adapted to other spaces, 
for example, the spectra of parabolic composition operators have been generalized 
to weighted Bergman spaces by Bayart [1]. 

Let's recall that the weighted Bergman space A 2 a (B N ) is the space of all analytic 
functions / in B N such that 

ii/ifta = / i/wi 2 (i-M 2 r^w<°o 

JB N 

for a > —1. For the notational conveniences, we set A^^Bjy) = H 2 {B^). Let 
f( z ) = Sfclo fk( z ) De the homogeneous expansion of /. For s > 0, the fractional 
derivative of / order s is defined by 

oo 

R s f(z) = J2k s fk(z). 
fc=i 

Thus, for a > — 1 and s > 0, the holomorphic Sobolev space A 2 as is defined as 

A 2 a>s (B N ) = {fe H{B N ) : R s f G A 2 a (B N )} 

with the norm ||/|U| S = II^VlUs + 1/(0)1- Koo and Park rrg] proved that C v is 
bounded on A 2 a s (Bn) if and only if ip satisfies Wogen's condition for ip G C S+4 {B^). 
As we know, any linear fractional self-map of Bn satisfies Wogen's condition (see 
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[12J). This implies that all linear fractional composition operators are bounded on 

Let H 2 ((3,Bn) be the weighted Hardy space with the weight f3(k) — (k + l) v , 
where v is a real number. Its norm is given by 

oo 

ii/ii^w)=Eii/*hw- 



It will be convenient to work with an equivalent norm on H 2 (fi,B]\r), the following 
lemma is a generalization of Lemma 1.2 in [14] to the unit ball. 



Lemma 4.1. Suppose that v is a real number and s > is an integer such that 
s > v. Then the norm of the weighted Hardy space H 2 ((3,Bn) with the weight 
(3{k) — (k + l) v is equivalent to the norm of the Sobolev space A\ s _ 2v _ x s - 

Proof. Let / = J2T=ofk{ z ) = HT=o Y^\ a \=k a » z ° be in H 2 ((3,B N ). We compute 
that 



\R s f\\% 



B N 



E 2 k&a « 

k=l \a\=k 



2 



(1 - \z\ 2 ) c dv(z) 



oo „! „ 

k2S \ a «\ 2 / r 2 \\-r 2 ) c rdr / 

k=l \a\=k ^° ^ 



r 2 ) c rdr / \C\ da(() 

8B N 



k=l \a\=k 

which is equivalent to 



(iV-l + Jfe)! (c + k + 



(N-iy.al u2s _ c _, 



I «i (N-l + k)\ 

k=l \a\=k K ' 

according to Stirling's formula. On the other hand, we have 

ii/is™ = E iiaii 2 (* + ir = t E i^i' ^-'x+'t). ' {k + ir - 

k=0 k=0 \a\=k V >' 

Note that \\j\\ A \ a = ||^ s /I|a2 + |/(0)|. If 2s-c-1 = 2v and s > u, i.e. c = 2s-2i/-l 
with c > —1, then the norm of the weighted Hardy space H 2 (f3, B^) is comparable 
with that of the Sobolev space A\ s _ 2v _ x s . □ 

Thus, using Lemma 4.1, we have the following result for weighted Hardy spaces. 

Proposition 4.2. Let <p be a linear fractional self-map of B N . Then is bounded 
on the weighted Hardy space H 2 ((3, B N ) with the weight (3{k) — (k + l) v , where v is 
a real number. 

Therefore, if we can calculate the spectral radii of linear fractional composition 
operators on H 2 ((3,B N ) with the weight (3{k) — (k + l) v , one subject of this topic 
shall be to characterize the spectra of these composition operators. 
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